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CURRENT DEVELOPMENTS IN PROFICIENCY 
EVALUATION FOR AFRICAN LANGUAGES 

INTRODUCTION 



David J. Dwyer 
Michigan State University 

In the last ten years, the federally funded Title VI African Studies Cen- 
ters have experienced increasing pressure to incorporate oral language 
profiden <7 evaluation into their AfHcan language programs.’ 

This emphasis is clearly articulated in the 1987 guidelines statement for 
Title VI African Studies Center applications, which specifies that these 
centers will be evaluated “by the scope of the competence-based language 
instruction which is being used or developed, the adequa^ of instructional 
resources, and the nature of language proficiency requirements.”^ 

The term “competence-based language instruction,” according to the 
Federal Renter, means “a training program which has defined functional 
language use objectives and whose evaluation measures for students can be 
linked to national standards.” 

Up until this point, the popular consensus among Africanist language 
teachers concerning language proficiency evaluation embraced the follow- 
ing points: 

1. No effective measures ensted for any language. While the FSI 
(Foreign Serwee Institute) approach to oral profidenqr evaluation was reli- 
ablp, the divisions or levels were so broad as to render them useless. 

2. Given that the Title VI Centers have identified 82 major national or 
intematicmal African languages (out of a total of some 1500 African lan- 
guages) for which instruction ou^t to be made available in this country, 
the task of establishing a national standard for each of these is impractical.^ 

3. Furthermore, such standards could not be eadly established without 
seriously impairing certain approaches to or stj^ in language teaching, al- 
though most could see some advantages in su^ an evaluation metric. 

Over the last ten years (be^nning with a new directkms conference in 
1979 described in footnote 3), the Title VI Centers conduded that the most 
effective way to make use of limited monetary and material resources in 
providing quality instruction in the numerous African languages was to 
work coherently together in identifying, planning, and carrying out projects 
aimed at improving African language instruction in the United States. 

Such efforts have led to a series of individual projects, wdiich have re- 
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ceived the collective support of other Utle VI institutions/ Such projects 
have included the writing of language learning textbooks and dictionaries; 
the identification, worldwide, of language learning resources— institutional, 
material, and individual; and a considerable amount of work in the area of 
oral proficiency evaluation. 

Because this activity has been intense and considerable, the African 
language program coordinators have given prr^ess reports at the last few 
African Studies Association Meetings. After our presentation at the Den- 
ver 1987 meetings, it was decided to publish a record of our progress. As a 
result, I have suggested to the language coordinators of each of the Title VI 
Centers that we assemble the current voliune documenting our progress 
and our cooperative spirit in this endeavor. 

In the process of coming to grips with the task of applying oral profi- 
ciency evaluation to African language learning, we have had to deal with 
the three concerns raised above. With respect to the concern of lack of 
scale, by subdividing the lower levels of the FSI, the American Council on 
the Teaching of Foreign Language (ACTFL) introduced a new oral lan- 
guage proficiency test. Now that there was an oral proficiency test avail- 
able for evaluating the progress of foreign language students, it became the 
task of the Africanist language teaching community to de,:ermine its appro- 
priateness for African languages. The results of which are reported in this 
collection. 

NOTES 

*At the time of this writing, the Utie VI African Studies Centen are Boston Univeisity, 
Indiana Univenity, Michigan State Univenity, Stanford Univetsity, University of California 
at Berkeley, Univeisity of Califoraia at Los Angeles, University of Florida, University 
of Illinois, Univenity of Wisconsin, and Yak Univenity. Stanford and Beikeky function ad- 
ministratively as a singk eenter. Notthwestem Univenity, whik previously funded, is not so 
currently. 

VMsraf Jlsgincr 52. 191 (Oct 2, 19S7) page 37D69. 

*This list of S2 languages, given here as Appendix C, was established at a 1979 Titk VI 
African Studies Centen worlobop entitled “African Language Instruction in the United 
Sutes: Direction and Priorities for the 1980’s repotted by Dwyer and Wiley, 1961. 

*A partial list of thase activitias is given in Appendix A 
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A BRIEF HISTORY OF 
PROFICIENCY TESTING 



Richard T. Thompson 
Dora E. Johnson 

Center for Applied Linguistics 
Washington, D.C. 



GENERIC GUIDELINES AND THE LCTLS 

The guidelines for language proGciency assessment have their roots in 
the efforts of the U.S. government’s language training community. The 
American Council on the Teaching of Foreign Languages (AClT'L) and 
the Educational Testing Service spearheaded the movement to adapt the 
government Interagency Language Roundtable (ILR) proficiency descrip- 
tions and guidelines for use in foreign language programs in colleges and 
universities. Since 1981, non-language programs served as a foundation for 
the development of revised curricula. 

Much of the early work in developing the guidelines was based on 
Spanish, French, and German. As the circle mdened to include languages 
such as Russian, Chinese, Japanese, and Arabic, it quickly became 
apparent that the original guidelines were too Eurocentric. The two most 
obN^ous problems were a bias toward grammatical categories of western 
European languages such as tense and gender and the concern that learn- 
ers would require much time to master the principles and m echani cs of a 
non-Roman writing system. 

Efforts to expand the ACTFL guidelines to accommodate the less com- 
monly taught lan g ua ges (LCTLs) began with the development of guide- 
lines for Chinese, Japanese, and Russian and vnth the truning for testers 
for these languages. Tester training for Arabic and Portuguese followed 
soon thereafter. Workshops and familiarization projects were expanded to 
include teachers of Hindi, Indonerian, and some African lang ua g es. 

ADAPTING THE GUIDELINES TO 
FIT SPECIFIC LCTLS 

To apply the generic guidelines to the construction of proficiency de- 
scriptions for a particular language, the target language itself must be care- 
fully assessed. Factors such as cultural context, appropriate content, and 
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what constitutes accuracy must be taken into account for each language. 
Theoretical problems in adapting the generic guidelines to a particular lan- 
guage include complex morphologies in Russian, diglossia in Arabic, the 
early appearance of re^er in Indonesian and Japanese, and the presence 
of Hindi-English code switching at high le^«is of profidenty among edu- 
cated native Hindi speakers. The nature of writing systems such as those 
used in Chinese and Japanese also present a special challenge to the devel- 
opment of guidelines because the length of training required to learn these 
languages is greater than that required to learn Spanish or French. 

Teachers of Arabic, for example, are now discussing ways in which vari- 
ous dialects of Arabic can be accommodated when testing for profidency. 
The generic guidelines were developed to test a full range of oral profi- 
ciency, including informal conversation which, in Arabic, is generally con- 
ducted in the local dialect of Arabic. Modem Standard Arabic (MSA), the 
language of the print, and, to a considerable degree, of the broadcast me- 
dia, is also widely used in more formal and international settings, although 
the extent to which native speakers 'will be prepared to switch registers var- 
ies considerably from one dialect to another. The general consensus at 
present is to seek a compromise while further study of the problems in de- 
veloping guidelines for Arabic continues. Thus, iidien testing for profi- 
ciency in Arabic, tester and candidate replicate the situation in the Arab 
wK)rl(l itself by identifying through the interview process the common lan- 
guage base through which they can communicate. Testers will accept re- 
sponses in MSA and/or any colloquial dialect with which they are familiar. 
Because an ability to commimicate in both MSA and a dialect is character- 
istic of native speakers, profidenq^ in both MSA and a colloquial variety is 
required to achieve a “superior" rating in Arabic. 

Another practical consideration is how to handle a language’s sodolin- 
guistic peculiarities wdien developing language-specific proficiency guide- 
lines. For example, Indonesian requires numerate recognition of strict 
rules that govern appropriate style v^en addressing others. Hence, forms 
of address are taught from the very beginning in Indonesian courses, 
and the guidelines for Indonesian must reflect this and other neces- 
sary socioiinguistic rules that define human relationships and status pecu- 
liar to Indonesian society. 

TRAINING LANGUAGE-SPECIFIC TESTERS 

Because language-specific tester training currently exists in only a 
handful of the LCTLs, it is likely that most initial training will be mediated 
through English or through another language known to the prospective 
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tester, for example, training through English or French for Asian and 
African specialists. Training might also be carried out in a l a ng ua g e that is 
structuraUy similar to the target language, such as training through Russian 
in order to test in another Sla^dc language. Another solution is to pair the 
tester with a native speaker of the target language and allow the tester to 
work with the native speaker m a capacity similar to that used in the former 
linguist /informant method of language instruction. Thus, the trained 
tester guides the informant through the interview, and the two make a joint 
decision as to the final rating. It is also possible that semi-direct tests of 
oral proficient^ mil be developed and validated against the oral interview 
for those much less commonly taught languages for which developing a 
cadre of trained testers may not be possible in the near future. 

DEVELOPING COMPETENCY-BASED 
LANGUAGE PROGRAMS 

The language training prc^ams funded by the U.S. Department of 
Education are now required to provide suffident evidence that they are 
making changes to include competency-based teaching and appropriate 
testing in their uutividual institutions. Programs are already beginning to 
institute different approaches to the development of language teaching 
materials and curricula. ProHdency is a major topic of concern at summer 
institutes. The African language teaching community has developed a set 
of common goals and priorities as well as possible avenues of coordination 
between centers. Semi-direct tests for the LCTLs are be ginning to be de- 
veloped based on the ACTFL guidelines and adapted for specific target 
languages. The Center for Applied Linguistics (CAL) has already devel- 
oped semi-direct tests in Portuguese, Chinese, Hebrew, Indonesian, and 
Hausa, and the University of Pennsylvania has developed a semi-direct test 
for Hindi. 

LCTLS AND POLICY QUESTIONS 

The appearance of recent legislation and regulations relating to profi- 
ciency testing and competency-based language programs has aeated a new 
set of policy questions that funding agencies and post-secondary institu- 
tions will have to face. The Education Amendments of 1986 included a 
number of ugnificant changes in Title VI of the Higher Education Act 
(Foreign Language and Area Studies Fellowships Program, 1968), udiich is 
the le^ative basis for several of the international education programs 
administered by the Center for International Education in the U.S. De- 
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partment of Education. Tht re will be intense competition for the Umited 
training resources currently available as universities seek to come into 
compliance with these lepslative changes.' The UJS. Department of Edu- 
cation, academia, and the major professional foreign language associations 
mil need to cooperate in setting realistic priorities and in developing the 
necessary guidelines. The most pressing question is one of deddii^ v^ch 
languages or language groups are more important and should have guide- 
lines developed first. The second pressing question is how the nearly ISO 
national resource centers and fellowships programs in foreign lan g mi gc.,s, 
area, and international studies, fimd^ in part by the U.S. Depart- 
ment of Education under Title VI of the Higher Education Act 
(Thompson, Thompson and Hiple, 1988). For a more complete disucssion 
of the issues concerning the less commonly taught languages, see P. Lowe, 
Jr. and C.W. Stansfield, eds.. Second Language Proficiency Assessment: 
Current Issues, Language in Education: Theory and Practice, No. 70. Wash- 
ington, DC: Center for Applied Linguistics (ERIC Document Reproduc- 
tion Service No. ED 296 612). 

At the secondary school level, schools are beginning to teach languages 
other than Spanish, French, and German. Russian, Japanese, Chinese, and 
in some places Arabic, are now taught in several major urban school sys- 
tems all over the country. With guidance and encouragement from ^e 
professional community, state systems will need to adopt proficiency 
assessment procedures <n these languages to enable teadters to meet 
certification requirements. Such areas of foreign language curricula as 
placement, syllabus design, course and program evaluation, entry and exit 
requirements, and required proficiency levels of teaching assistants and 
teachers will also cha^e as a result of the language-specific proficiency 
tests (Byrnes, 1987). 

RESEARCH AGENDA 

For the moment, the application of the generic guidelines to the LCTLs 
has raised questions that offer opportunities for new research in the field of 
foreign lan^age acquisition and learning. A number of scholars involved 
ill the field of second language acquisition and testing have suggested such 
areas of possible research as the manmum level of proficiency that can be 
reached under certain conditions, the variables that affect learning, the re- 
lationship between second language (L2) acquisition and L2 instruction, 
and the effect of formal vs. informal learning. Such research calls for inter- 
disciplinary cooperation and training. 

At the testing level, researchers are calling attention to issues in the 
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area of interrater reliability. Examples of these issues are interrater relia- 
bility across 1 a n g»ragr-s reliability between government- and ACTFL-certi- 
fied oral proficiency testers, examination of differences in testing one’s own 
students as opposed to testing someone else’s, investigation of possible dif- 
ferences between native and nonnative interviewers mth regard to both 
elicitation procedures and rating, and the maintenance of rater reliability 
overtime. 

Most importantly, the establishment of generic guidelines and the 
subsequent evolution of the proficiency movement provide research oppor- 
tunities by ^ring LCTL practitioners a framework within which second 
language acquisition can be observed and evaluated. This research can be 
applied to both oral proficiency and the acquisition of receptive skills. 

NOTES 

^Foreign Language and Areas Studies Fellowships Programs (1968), P 657,20 
U.S.C P 1022. 



Note: This article has been published in Eric Digest (December 1988). 
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THE 1986 STANFORD ACTFL 
TRAINING WORKSHOP 



William Lebeo 

Stanford University 



BACKGROUND 

Not too many years ago, I attended a meeting of Title VI Center Direc- 
tors in Washington, whicb included workshops on a variety of topics of in- 
terest to area studies center directors. One of the workshops was devoted 
to language proHciency testing, a topic that I had never previously encoun- 
tered in my work as an African language coordinator. 

The meeting began abruptly with a declaration by one of the partici- 
pants that profldency testing was the wave of the future, the solution to the 
problems that had plagued language teaching for so many years. I felt as if 
1 had been injected into the middle of a discussion, the first part of which 
had perhaps taken place behind closed doors. As I tried to foUow the sub- 
stance of the ensuing discussion, 1 could not help musing that this was the 
latest bandwagon that area centers were being forced by Washington to 
jump on, joining or perhaps replacing earlier ones, like the efforts to get us 
to do more for outreach or to lure more professional school students into 
our language classes. 

My cynical attitude did not last very long. The 1984 Michigan State 
University workshop on "Guidelines for the Preparation and Evaluation of 
Teaching Materials for Less Commonly Taught Languages” made clear 
the importance of communicative competence in language teaching. In 
addition, the experience of conducting intensive advanced l a ng ua g e pro- 
grams in Africa, in which "advanced” simply meant that students had gone 
through two years of prior instruction in the language, taught me that it 
would make good sense to gear our language classes to profidenqr (ability 
to deal with the lan guage as a tool of commimication) rather than to 
achievement (ability to score highly on tests of grammar and vocabulary). 

At the Michigan State University Conference, Steve Krashen had docu- 
mented the values of orienting class time to communicative interactions 
between instructor and students. It was not only more fun that way, it was 
also more effective, judging from the assumed goal of oral proficiency. 
The response of the African language teachers and coordinators there was 
overwhelmingly positive. Proficiency testing prodded a need complement 
to this idea: if we were to orient our students toward co mm u ni ca ti on in the 

Current Developments in Proficiency Evaluation for African Languages 9 



10 



language, it was more sensible to focus our testing on their ability to com- 
municate effectively rather than on their ability to remember grammatical 
constructions and vocabulary per se. 

PROFICIENCY TESTING 

We had stumbled on proficiency testing somewhat by accident in the 
1982 and 1984 siunmer intensive Hausa courses in Nigeria. In both 
instances, we were faced with twelve students v^o had all completed the 
requisite course work in introductory and intermediate Hausa, but v^o dif- 
fered widely in their ability to function in the language . We had already 
planned to divide them into four groups of three for the purposes of the 
course, and we decided that the best criterion for grouping was proficiency. 
So on the first two days of the course, we administered a batch of written 
diagnostic tests and individual oral interviews conducted by native speakers 
in the presence of the program directors. Conducting these tests more or 
less in a vacuum, with nothing but common sense to go on, pre-disposed 
me to look favorably at the notion of standardized proficient^ testing tech- 
niques. 

THE STANFORD WORKSHOP 

In the spring of 1985, Stanford’s Center for Research in International 
Studies sponsored a workshop on proficiency testing in French and 
Spanish, conducted by David Hiple of the American Council on the Teach- 
ing of Foreign Languages (ACTFL). I attended and was surprised and 
gratified to learn that the b^c interviewing techniques were both well es- 
tablished and weU motivated. In subsequent conversations with David, I 
learned that he was interested in developing ways of adapting ACTFL in- 
terviewing techniques to testing oral proficiency in less commonly taught 
languages. 

^th support from the Stanford/Berkeley Jomt Center for African 
Studies and Stanford’s Committee on Research in International Studies, I 
organized a workshop on “Proficiency Testing in African Languages” at 
Stanford in the spring of 1966. The workshop was attended by lan gu a g f. 
coordinators representing almost all of the federally funded African studies 
centers in the U.S. The individual centers indicated their interest in this 
venture by providing travel funds for their participants on rather short no- 
tice. The participants themselves came to the conference with a variety of 
ex p ectations. The ones I remember ranged frtxn “Let’s see vdiat the gov- 
ernment wants to shove down our throats this time” to “We need to deal 
with the enemy out of knowledge rather out of ignorance.” 
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Da\nd Hiple ran the workshop. The first two days were conducted in 
the regular ACTFL fashion, with introductory lectures on the basic tech- 
niques and practice interviews using English as the target lang ua g e. The 
group responded positively to the demonstration that on the one hand 
there were some special skills to learn in testing oral proficiency and that 
on the other hand the techniques were quite reasonable. It was satisfying 
to see that, structuring an oral interwew on ACTFL guidelines, one could 
both conduct an interesting, natural conversation with a student and at the 
same time produce substantial agreement among the observers about 
where the interviewee’s performance fell on the ACTFL scale. 

The workshop then focused on adapting the interviewing and evalu- 
ation procedures to African languages. After a general discussion of how 
to transfer our newly acquired skills to domains with linguistic and cultural 
featmes were possibly quite different from those encountered in 
English, we interviewed one another using Hausa, Swahili, and West 
African Pidgin as target lan guag es. After critiquing performances of inter- 
viewers and interviewees, we called in a set of “real” African language stu- 
dents and interviewed and evaluated them. 

RESULTS 

The group came away with the basic impression that transferring profi- 
aency testing s kills from English to African languag es was less problematic 
than might have been expected. It was quite striking to see the group agree 
on ratings of students’ performances, even though guidelines for grammati- 
cal and cultural criteria for the specific African languages had not been 
worked out in advance and despite the fact that (apart from the inter- 
viewer, who was proficient in the language being tested) many group mem- 
bers were not well versed in the different languages <rf the interviews. 
While there were some unresolved feelings about whether these tests 
tapped a truly representative set of the linguistic and cultural resources 
relevant to evaluating a student’s proficiency in an African lang ua g e, our 
shared experience uncovered an interest that has led to a series of more 
substantive efforts at implementing oral proficiency interviews in African 
language programs. 
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THE 1987 MADISON-MSU 
TEAMWORKSHOP‘ 

David J.Divyei* 
Michigan State University 



INTRODUCTION 

This paper summarizes the results of a workshop sponsorc^ by 
Michigan State Univeraty and held on the campus of the Univer si^ o f 
Wisconsin. This workshop was a follow-up of the earlier Stanford ACTFL 
workshop (see the Lcbcn article in this volume) and had as a major focus 
the application of ACTFL oral language profidency testing to African lan- 
guages. The specific problem addressed was whether an alternative profi- 
ciency testing procedure could be developed for those languag es for which 
there may never be certified ACTFL proficiency testers. This conference 
organized and coordinated by the author, was conducted by three ACTFL 
consultants (David Hiple, ACTFL trainer and representative; Sally 
Magnan, University of Wisconsin and ACTFL trainer for French; and 
Roger Allen, University of Pennsjivama and ACTFL trainer for Arabic). 
Many representatives from African language programs throughout the 
United States had also attended the ACTFL profidency workshop at Stan- 
ford University the predous year.* 

PROFICIENCY EVALUATION 

The Stanford workshop marked a turning of attention to ACTFL oral 
l^ngiiay. profidency evaluation by the Title VI Afiican Studies Centers. 
The partidpants of that workshop conduded that despite some Eurocen- 
tric bias, the ACTFL model was based on sound prindples. They ex- 
pressed the belief that, with a reasonable amount of effort, the model could 
be applied to Afirican languages to provide a reliable and ^d means of 
evaluating learner profideniy. In addition, conference participants agreed 
to make an effort to achieve ACTFL profidency cei^cation in Enj^ 
with the aim of working toward developing ACTFL guideline for the hi ^- 
est priority Afiican languages. They also agreed to work with ACTFL to 
establish a network of certified evaluators for those languages.* F u^er- 
more, partidpants dedded to experiment informally, u s i n g the ACTFL 
model vrith evaluating students lea rn i n g African languages. 
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BENEFITS OF ACTFL 
PROFICIENCY TESTING 

The 1987 Madison workshop began, following a suggestion of the Stan- 
ford conference, with participants identifying a number of important bene- 
fits assodated with an ACTFL capability for African l*n gimgf« These 
benefits are listed in Appendix A. Any such benefit derives from the ca- 
pacity of the ACITL model to provide a valid and reliable statf-mrnt 
of language (speaking, listening, reading, writing) profiden^ which is inde- 
pendent of the manner and methods of teaching and learning, the institu- 
tion, the learning materials used, and the lan gnagf. itself. This, in effect, 
provides a common metric vdiich can be used aaoss programs, across lan- 
guages, and across pedagogical methodolo^es. 

THE PROBLEM WITH RESPECT TO 
AFRICAN LANGUAGES 

The problem confi'onting profidency testing for African languages 
stems from the fact that Africa is a re^on of considerable linguistic 
diversity, having somewhere between 1500 and 2000 lan g ua ggji; . In addi- 
tion, the resources for studying and teaching them in this country are quite 
limited. It is dear then that, ^ven the present model of training an oral 
profidency evaluator for a specific language, certified profiden^ testers 
will never be trained for most of these Afiican lan gimgys , The problem has 
been alleviated someudut by the development of a priority based on 
the number of speakers, re^onal, national or international use, other 
factors.^ 

THE TEAM MODEL 

As a possible means df coping with this problem, the partidpants of the 
worki^op were asked to examine an alternative format to the ACTFL oral 
profidenqr interview. This alternative (team) model involves an ACTFL 
profidency interview that is not conducted by a single, ACTFL wrtifwi 
individual proficient in the target language. Instead, the interview is con- 
ducted by a team consisting of a proficient speaker of the target 
udio is not a trained proficiency evaluator and an ACTFL trained and certi- 
fied proficiency evaluator vibio is not necessarily proficient b the tar- 
get language. The team works together to develop a “ratable sample”* of 
the interviewee and the evaluator, on the basis of the sample and subse- 
quent redew of the interview, determbes the bterviewee’s profidency 
level 
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DISCUSSION OF THE TEAM MODEL 

The partidpants conduded that the team model promising, but 
that a number of modifications may be necessa r y to avoid potential prob- 
lems. The standard ACTFL interview has the following sequential compo- 
nents: a) warm-up, b) level check to establish the highest level of sustained 
abiUty, c) probes to establish the level at «diich lan^e can no longer be 
sustained, and d) wind-down. (A brief description of the ACTFL levels of 
profiden <7 is given in Appendix B.) This procedure may have to be inter- 
rupted by one or two breaks to allow the evaluator and the native speaker 
to consult on the speech sample that is being obtained. Interviewees 
should be made aware of such breaks in advance and the breaks should 
appear as a natural aspect of the interview. One way to achieve this would 
be to one segment of the interview as a rde-playing dtuation. 

Partidpants agreed that instructions for the native speaker need to be 
developed. These instructions should be relatively brief (one to three 
pages) explaining the procedure and the native speaker’s role in the proc- 
ess and possibfy augmented with a video tape further illustrating the proce- 
dure. The exact nature of these instructions would be the topic of another 
workshop (see below). 

Partidpants also agreed that the certification of a team evaluator ought 
to involve special tr aining such as workshops for Africanists who have al- 
ready been certified as ACTFL evaluators in a specific language such as 

English. ^ 

The remedies for controlling both evaluator and native speaker biases 
involve either submitting interview Upes to evaluator teams at other 
institutions for a second opinion or having other evaluator teams test da 
te lr ptionn interviews.* Solutions for evaluator atrophy (^ing from in- 
frequent interviewing) and for maintaining level reliability induded 4e 
bolding of annual or Uannual refresher co urses a nd the conducting of in- 
terviews in one place so that a number of ACTFL teams from different lo- 
cations could be in attendance. 

Most of the attention, however, was pven to the question of how the 
team mterview could be structured to provide a raUble sample. Here, 
three spedfic suggestions were offered: i) modifying the structoe of the 
mterview, ii) special training for the native speaker, and iii) special training 
for the equator. 

While aU the proposed remedies need to be evaluated through testi^ 
and experimenUtion, the sense of the workshop was that remedies did exiM 
for the above-mentioned problems and that the ACTFL t e a m niodel did 
represent a realistic approach to proficiency evaluation for African lan- 
guages. 
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future directions 



With near consensus on the potential of the team model and its appro- 
priateness for African l a n g u ages, the group went on to suggest a three year 
plan to reach these goals: 

1988 - -A standard ACTFL Workshop posabty using Rnglish^ French, 
and Arabic as the languages of certification to be held at the University of 
Wisconsin. 

1989- A workshop to explore the design of the alternative ACTFL 
team approach that em ph as i zes the development of instructions for the na- 
tive speaker described above to be held at UCLA under the leadership of a 
group headed by Russell Schuh and including Tucker Childs and Will Le- 
ben. 

1990 - Two workshops establishing guidelines for the ACTFL profi- 
cien<y evaluation of Hausa (coordinated by Boston University) and Swahili 
(coordinated by Yale University). 

1990-A second workshop to finalize the development of the ACTFL 
team model. The time and location of this workshop arc yet to be deter- 
mined. 

Another set of activities was suggested by participants. Boston Univer- 
Mty would begin to archive Hausa proficiency interviews and Yale Univer- 
sity would do the same for Swahili Others expressed interest in maVSng 
transcripts of the interviews with varying degrees of detail, inrfSrating that 
su^ transcripts would be useful for research and that such activities should 
be included in center proposals. 

NOTES 

IP“ “ “ wnioo of a paper that has appeared elsewhere as Dwwr and Hiple 

(1987) and Dwyer and Hiple (1988). 
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Univeiiity of California at Beifcelqf; John Chtteahe, Univenity of Zambia; Dustin CoweU, 
Univenity of 'Wlaoaaain; Abraham Demos, N o ith we at e n i Univenity; KaUmriae Demuth, 
Bostoo Univenity; Ivan Dihoff, Ohio Sttte Univenity; Mallafe Dnime, Univenity of Illi- 
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ttctiw certiTiaitkm m an ACTFL proficieiicy evaluator, a trainee must be a supe- 
rior level speaker of the taifet languafc, and must <kmoiistfate the abiUty to elicit full 
qweeh using standard interview techniques and to rate the samples accurate^ on 

the rating tcfle- Most testers undergo a four-day woifcshop> followed by a post wc»kshop 

training phase. In this phase, trainees conduct ten ttped interviews with learners at var^ 

levels of proficient in the target lanjpiage. These tapes ate reviewed It the certified tminer 
and comments are given to the trainee who then conducts an additkmal fifteen taped inter- 
views, apin of various levels, to qualify for certificati^ If the elkitttion technique eriiib- 
ited in the interviews k deemed adequate and the ratings of profidency agree with those of 
the trainer, the trainee will be certified as an ACTFL proficiency evaluator for the target lan- 
guage. 

^Details cooceming this list appear in Dwyer and Wil^, 1981. 

^A sample is considered ratable when the interview contaiiu evidence that the inter- 
viewee can sustain language at the evaluated level, that the interviewee canned perform con- 
sistently at the next hij^iest level, and In the case ci a “high” rating, that the interviewee can 
perform at the next highest level at least 50% of the time. 

•a partial listing of second opinion evaluation resources is given in Appendix C 
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AFRICAN LANGUAGE TEACHING AND 
ORAL PROFICIENCY TESTING* 



Katherine Demuth 

Boston University 

This paper details some of the methods used at Boston University to fa- 
cilitate communicative competence in African languages. It identifies cer- 
tain strate^es used and shows how the goals of the curriculum design are 
consistent with those of oral proficiency testing. 

INTRODUCTION 

The African language program at Boston University focuses on helping 
students develop maximally effective oral communication skills in the Afri- 
can languages they are studying. Class size is small (5-10 students) and 
most students plan to use their language of study in research, work, or 
travel situations, which will take them to Africa in the near future. It is for 
these reasons t^t the program has always had a spoken/commimicative 
competence bias, and it has seen the development of oral proficiency test- 
mg guidelines for the teaching of African languages as a positive move m a 
productive direction. In fact, the incorporation of oral proficiency testing 
is, in many respects, an extension of the original goals of the African lan- 
guage program. V/hile other language programs, both African and non- 
African, have resisted the incorporation of profidency testing guidelines, 
feeling that its implementation interferes with and even dictates the type of 
teaching methodologies that would have to be used in the classroom, there 
has been no such “discord” between the goals and the methods used in the 
Boston University African Language Program; if anything, the introduction 
and joint-cooperative development of oral profidency testing guidelines 
has helped us articulate, for ourselves, the types of language competence 
goals we would like our students to achieve. 

Realizing that other programs may have different goals that are not 
met by these new developments, I would like to focus the rest of this dis- 
cussion toward those programs that do have ri mi la r goals, and ex- 
plore various methodolo^cal approaches which the Boston University 
African Ijing na g e Program has developed and incorporated into classroom 
teaching to more effectively meet those goals. The methodological 
approaches presented here should prove useful for other institutions con- 
cerned with attaining rimilar communicative competence goals. The re- 
current Developments in Proficient Evaluation for African Languages 19 
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mainder of this paper will discuss the standard two-year Boston University 
African Language Program curriculum designed to facilitate oral proG- 
dency. While we are constantly innovating and testing new approaches to 
the development of oral proGdency skills, the foUowing presents the core 
around which other developments take place. 

FIRST YEAR COURSE/nRST SEMESTER 

The Grst semester of the Grst year course is almost entirely oral; books 
and written materials are used sparingly. Classes are conducted almost 
solely in the target language, with Gttle or no English and only a list of rele- 
vant vocabulary items which facilitate out of class study. Students are en- 
couraged to listen to tapes of the relevant lessons outdde of class. By the 
end of the Grst week students can carry out rudimentary greetings and ex- 
changes in the target language. 

As the semester progresses students increase their command of the lan- 
guage. They are continually provided vdth updated vocabulary lists, and 
given the vocabulary needed to ask about the grammar of the language in 
the language itself. Development of vocabulary, grammatical structures, 
and competence with certain conversational toincs is facilitated through 
the use of structured oral exercises that incorporate pictures and other vis- 
ual aids. Quizzes are oral; for instance, students des^be a picture or tell a 
story, they may also report personal experiences, such as v^ere they went 
over vacations, how they traveled, who they saw, vdut they did, and so 
forth. 

About this time the class writes and presents a skit to the rest of the 
language classes at the semi-armual African language Prc^am Diiuer 
and Party, vdiere they also cook food from the pertinent region of Africa, 
learning the names for different food items, dishes, and vocabulary for how 
to prepare them. Some reading is introduced, and students are encouraged 
to read on their own over the winter semester break. 

The Gnal exam is oral, consisting of student presentations to the class, 
followed by questions from the class, and an indi^ual “interview” conver- 
sation between instructor and student, covering the ba^ communicative 
topics of the course. While this is not a formal ACTFL oral proficiency in- 
terview, it is similar in that it tests to see vdiether the student can cany on a 
conversation v^ch incorporates the material covered in the course. By the 
end of the first semester students have a working oral facility with the lan- 
guage, and they have had an introduction to cultural aspects of language 
use and to elementary reading. 
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SECOND SEMESTER 

During the second semester there is continued focus on developing oral 
conummicative skills, but the methods become more diversified. While 
oral presentations and conversation continue to be a major component of 
the classroom, students are eiqpected to incorporate more reading and writ- 
ing mto their out of class work. This work is then discussed in the class- 
room, in the target language. Films and film-strips are scheduled once a 
week, providing a rich basis for discussion, which introduces new vocabu- 
lary and new insight into the culture. Weekly quizzes, which now include 
some writing, complement weekly composition assignments, providing an 
opportmiity for refinement of grammatical details and development of 
creative writing skills. 

Students again write and perform a skit for the semi-annual Afirican 
Dinner/Party, and this time it is video-taped, to be shown in future classes. 
The skit provides students with an opportunity to work together and 
express aeative talents which often do not surface in other contexts. It fo- 
cuses their language skills in such a way that there is a noticeable improve- 
ment in their verbal abilities. At the same time it involves them in some of 
the cultural realities which are reflected in the use of the language they are 
learning. For instance, several of the more successful skits have included 
the enactment of proverbs, short stories or songs, vriiile others have cre- 
ated ‘social commentary situations where appropriate social behavior is 
either observed or violated, either in speech or in action. 

At the close of the second semester all students are required to ^ve an 
oral/written report to the class on a topic of their choice. \^th the assis- 
tance of the instructor and outside readings, students learn the new vo- 
cabulary needed to discuss their individual topics, and they teach this new 
vocabuUuy to the rest of the class. For many of the graduate students this 
is an opportunity to develop vocabulary, ounmunicative skills, and bibliog- 
raphy in their projected area of future African research. Examples of paut 
presentations have included topics such as health economics in East Africa, 
oral narratives and praise poems as a source for historical research, re- 
gional muric from an ethnomusicological viewpoint, and educational eiq>e- 
riences of persons frcmi a particular country. This provides students with 
the opportunity to e]q)lore the use of their language of study in the target 
language itself, learning the vocabulary necessary to communicate to 
speakers of the language the importance the work which they will be 
conducting. 

For undergraduate students vriio may not have immediate research 
goals in Africa, the final oral/written report also provides an opportunity 
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for exploring areas of interest. Students at tUs level are encouraged to in- 
tegrate their final report vrith their other academic or non-academic inter- 
ests. For example, one student was writing a report in an African history 
class on various aspects of agricultural development in Kenya. His final 
report was i\ presentation in Kiswahili vriiich covered some of the same 
material that he was researching for his other class. Other undergraduate 
presentations have included African art forms and how thqr have influ- 
enced modem contemporary West m artists, an historical perspective on 
the discrimination in the delivery ot health care to black and white South 
Africans (student majoring in pre-med), a literary analysis, recitation, and 
discussion of selected Zulu praise poems (student interested in philosophy 
of language), and the crafting of a southern African musical instrument, 
discusaon of the historical origins and contemporary uses of the instru- 
ment, and how it is played, as well as a musical demonstration; the student 
sang and played the instrument (student interested in performing arts). In 
this way, undergraduates are also able to integrate the study of an African 
language and its culture into their other interests and concerns. In the 
process, they simultaneously leam more about the culture udiile improving 
their language skills. The final project thus provides all students with an 
opportunity to explore both the oral and written use of the target language 
in ways most appropriate to their individual interests, improving their com- 
mand of the language in the process. 

At the end of one year of study, students in the African L a ngu a g e Pro- 
gram are pven an oral profiden^ interview, either by the instructor of the 
course or by another trained speiiker/instructor of the language. This in- 
terview is not unlike that given after the first semester, but this time it fol- 
lows a more formal ACTFL-st^e rating. While part of the purpose of this 
interview is to evaluate how weU students..have learned the basic communi- 
cative skills they should have obtained from the class, the actual rating is 
used for internal purposes of the African language program as a means for 
evaluating how effective our courses have been at implementing the goals 
, we have set for ourselves. Recall that the focus of the Boston University 
African Language Program is to help students leam to use the target lan- 
guage in the communicative situations in adiich they will one day find 
themselves. The final oral profidenqr interview is as much an evaluation of 
our own success at meeting this goal as it is an evaluation of the students* 
individual progress. 

SECOND YEAR COURSE 



The second year course builds on the skills developed during the first 
year. There is a continued focus on the development communicative 
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skills on an ever widening range of topics. This is achieved through several 
approaches. First, film strips (vnthout the sound) dealing with various top- 
ics (agriculture, education, history, art, political change, and so forth) pro- 
vide a visual stimulus for development oS vocabulary centering around a 
certain topic. Films are also shown in order to provide a forum for discus- 
non and debate of relevant issues. Grammatical skills are developed and 
exercised as students discuss and debate the various issues raised. In 
addition, students are periodical^ asked to develop oral and written pres- 
entations on various topics raised in class or of particular interest to class 
members. Occasionally “guest speakers” of the target language are invited 
to class, and students take the opportunity to interview the viator. Thus, 
the development of oral skills continues to be the focus of the second year 
class* 

In addition to daily opportunities for discussion, the second year classes 
become much more heavily involved in reading and writing. Weekly writ- 
ten assignments follow the discussion of films and film strips, thus reinforc- 
ing new vocabulary and practice with new grammatical constructions. 
Short stories, short novels, plays, and poems are also incorporated, provid- 
ing an additional area for conversation, exchange of ideas with attention 
focused on particular areas of grammatical detail. Special grammatical 
components are practiced to fadlitate the use of more soplusticated gram- 
matical constructions in both oral and written work. 

The second year classes, like the first year classes, present a skit every 
semester. A research project/report is required at the end of every semes- 
ter for all students, and an oral interview is included along with a written 
exam at the end of each semester. At the end of the year, a second oral 
proficiency exam is conducted in accordance with ACTF'L guidelines, again 
primarily for program internal purposes. The results generally show sig- 
nificant improvement and are s^^ with the students. The students also 
have a copy of the general program guidelines and are aware of udiat types 
of communicative competence they are expected to have at the end of the 
course. They therefore make every effort to work toward this goal. 

CONCXUSION 

In this paper, I have demonstrated that the goals of the Boston Univer- 
sity African Language Program are entirely conristent with those of oral 
proficiency testing, and the definition of thew testing levels have helped us 
to articulate, both for ourselves and for our students, what the results of 
the courses ^ould be. This has been extremely helpfiil for the program in 
determining where to put our teaching energies and how best to e^nd 
our curriculum development resourcrs. It has also given students an im- 
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mediate sense of satisfaction and accomplishment; course evaluations are 
extremely high and students consistently report that they learned more in 
one or two years of Hausa or Swahili than they learned in European lan- 
guages where a more traditional approach had been applied. 



'This paper precentt a tanguafc program detign which has been developed over sevcial 
years thio^ the combiaed efforts of several linguists and African language program coor- 
dinators. I would therefore like to ackncwiedge the past and ongoingwoifc of my colleagues 
John Hutchison, Jennifer Yanco, and Stanley Cushtngham, who have all contributed in many 
ways to what the Boston Univeisity African L a ng uage Program is today. I thank them also 
for comments on this paper. 
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THE ROLE OF PROFICIENCY EVALUATION 
IN THE 1987 INTENSIVE ADVANCED 
HAUSA INSTITUTE (GPA) 

Jennifer J.Yaoco 

Boston Umversity 



INTRODUCTION 

The 1987 Hausa Groups Projects Abroad Program was an eight week 
(June 22 to August 16) intensive language institute held in Niamey, Niger, 
and administered by Boston University in cooperation with the Universite 
de Niamey. Ten students participated in the program. Of these, four had 
studied Hausa for the equivalent of three years, five for two years, and one 
for just one year. 

The institute consisted of three major components: 

1. Formal classroom instruaion 

2. Individual research 

3. Social and cultural activities (performances, field trips, lectures, 
participation in local celebrations) 

All instruction was competency-based, that is, our foremost goal was to in- 
crease students’ skills in using the language, rather than their knowledge 
about the structure of the language. While attention was paid to all skill 
areas (reading, writing, oral comprehension and production), the program 
was overwjielmingiy oral in orientation. Classroom work, while it centered 
around a text that students had prepared and included &e preparation of 
written exercises as well, nevertheless focused on the presentation of oral 
reports, story telling, theater, discussion. Social and cultural activities were 
designed to make use of and to improve students’ speaking and compre- 
hension skills and to provide students with the opportimity to participate in 
actiwties requiring interaction with Hausa speakers. Finidly, the individual 
research projects entailed preparing a written proposal, extenuve inter- 
viewing of Hausa speakers, and the presentation of a final oral report to 
fellow students and staff. 

Students worked on their writing skills by keeping a daily journal in 
Hausa, in v^ch they recorded their activities as well as their reactions to 
their new surroundings. These journals were corrected on a weekly basis 
by both project directors. Over the course of the eight-week institute there 
was sub^antial improvement in the written skills of each of the students. 
As a final written assignment, each student was required to submit a writ- 
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ten version of the report on his or her research. 

THE PROFICIENCY INTERVIEW 

While the journal and final report served as materials for evaluating 
students’ proficiency in the written language, our main emphasis in evalu- 
ation, as in instruction, was on oral skills. 

As a result of our participation in the Madison workshop, we decided 
to use an ACTFL-style interview for purposes of student evaluation. In the 
course of the program, we administered three interviews per student: one 
at the beginning of the program, one midway through, and one at the end 
of the program. All interviews were taped and transcribed for future use in 
developing guidelines. The interview consisted of the following parts: 

1. Warm-up: Examiner(s) and student exchange greetings and chat. 
The purpose of this is to put the student at ease. 

2. Level check: The examiner(s) finds the highest level at which the 
student is comfortably able to sustain communication. 

3. Probe: The examiner(s) probes to higher levels until the student’s 
language breaks down. This is done more than once to be certain that a 
level has been reached at which the student is incapable of sustaining con- 
versation. 

4. Wind-down: Like the warm-up, this serves to put the student at 
ease and to end the interview m a way that leaves the student with positive 
feelings about the mterview. 

As an internew tool we also used situation cards, which we developed 
ourselves, using as models those prepared by ACTFL. These present stu- 
dents with culturally appropriate "pr^lem utuations” in \^ch the student 
must play an assigned role in resol^^ a conflict. The cards we developed 
were especially adapted to the cultural context of Hausaphone West Af- 
rica. These were particularly useful in level checks. 

EVALUATION GUIDELINES 

As evaluation criteria we adopted a set of functional guidelines devel- 
oped at the Madison workshop in the spring 1987 (see the Biersteker 
article in this volume). These guidelines included functional specifica- 
tions for each of three major levels, each with a further division into low, 
mid, and high. The specifications for each level set out quite clearly and 
language-mdependently v^t an individual must be able to do in the lan- 
guage to have reached that level. Below is the list of criteria. 
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NOVICE 

Low 1 Responds to isolated words and high frequency phrases. Little 
ewdence of interactive ability aside from ability to exchange 
simple, common greetings. 

Mid 2 Use of short phrases to express elementary needs and courte- 
sies. Use of isolated words and phrases. Uses partner’s words 
and structures in responses consisting of isolated words and 
phrases. 

High 3 Emerging evidence of creatiwty, but heavy reliance on learned 
material. Limited to concrete situations. Emer^ng ability to 
interact in an exchange of personal information, for instance, 
responds to and formulates simple statements and basic ques- 
tions. 

INTERMEDIATE 

Low 4 Can ask and answer (wh)-questions. Can initiate and respond 
to simple statements. Can interact in task oriented sodal situ- 
ations. Can maintain face-to-face communication but repeti- 
tion and sympathetic interlocutor required. Able to maintain 
minimal mterchanges. Responds to and formulates simple 
statements and questions regarding the personal. 

Mid 5 Can ask and answer large variety of questions beyond inunedi- 
ate needs. Participates in conversation. In case of misunder- 
standing, makes efforts to continue conversation on topic or 
able to query by rephrasing. Maintains flow of conversation on 
conaete topics. May use and require careful speech. 

High 6 Initiates, sustains, and closes conversation. Emer^ng evidence 
of connected discourse, for instance, general conversation with 
number of strategies, able to elaborate on some of own points 
or those of interlocutor. 

ADVANCED LEVELS 

Advanced Full participant in conversation. Handles with confidence 
7 full range of tasks. More sophisticated use of communicative 
strategies. Able to rephrase without simplifying. Able to 
control and direct interchange by uung a variety of communi- 
cative strategies, for instance, chanpng the subject, summariz- 
ing, skillfully evading questions, taking various roles in the 
interaction. 
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Advanced 

Pius 

8 



Superior 

9 



Emerging evidence of ability to support opinions, ejqplain 
in detail, hypothec. SkillM use of parafdurase and cir- 
cumlocution. Emerging evidence of skill in paraphrase in 
dialogue, in ability to effectively argue/debatt points, ne- 
gotiate issues. Uses circumlocution to seek definitions. 
Commands tride variety of interactive and discourse stra- 
te^es, mcluding argumentation. Command of strategies 
listed in advanced plus. Emerpng evidence of ability to 
handle refers. 



ADMINISTRATION OF THE INTERVIEWS; 
RATINGS AND RESULTS 



Interviews were conducted three times during the institute, at the be- 
^nning, midway through, and in the fmal week. Progress from the first to 
the third interview for the group is noted in the table below: 



Level at 


Level at 




fust interview 


third mterview 




1 


3 


1 student 


2 


5 


3 students 


3 


5 


1 student 


3 


6 


1 student 


4 


5 


1 student 


4 


6 


2 students 


5 


6 


1 student 



We thus had four students vriio jumped three levels over the course of 
the program, four udio jumped two levels, and two who jumped one level 
The proficiency mterview served as a useful and accurate measure of 
students’ ability to speak and understand Hausa. We were particularly im- 
pressed by the high degree of mterrater reliability. The table below refers 
to the mterviews conducted midway through the program. These mter- 
views were rated by three different raters, each working mdependently. As 
can be noted, there were only three cases m vriiich the raters did not arrive 
at the same assessment, and m these cases the differences are always a 
matter of one level within one of the three major categories (Novice, In- 
termediate, Advanced). 
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Interview #2 



Student 


Rater #1 


Rater #2 


Rater #3 


1 


IM (5) 


IM (5) 


IM (5) 


2 


IM (5) 


IM (5) 


IM (5) 


3 


IH (6) 


M (6) 


IH (6) 


4 


IM (5) 


IM (5) 


IM (5) 


5* 


IL (4) 


IL/M (4/5) 


IM (5) 


6 


IM (5) 


IM (5) 


IM (5) 


7* 


IL (4) 


IL (4) 


IM (5) 


8* 


NH (3) 


NH (3) 


NM (2) 


9 


IM (5) 


IM (5) 


IM (5) 


10 


IM (5) 


IM (5) 


IM (5) 



*Disagreement among raters 

WIDER APPLICATIONS OF THE 
PROFICIENCY INTERVIEW 

We found the proficiency interview to be a useful, reliable, and fairly 
straightforward way to evaluate students’ oral skills. It provided both the 
student and staff with an accurate assessment of the student’s progress and 
allowed identification of particular areas in i^ch the student needed work. 
Aade from assessing students’ progress throughout the institute, the profi- 
den^ interview could further contribute to the success of intenrive sum- 
mer institutes in the following ways: 

1. Results of profidency interviews could be used in screen- 
ing candidates. Our experience showed that neither the number of 
years a candidate had studied the language nor the recommendations 
of instructors were reliable measures of a student’s level Students who 
had studied for three years were not necessarily more profident than 
the others, nor was the student vriio had had just one year of study the 
least profident in the group. If training in conducting the interview 
were available to more African language teachers and if proq>ective 
partidpants in summer programs could provide interview scores as part 
of their applications, we would have a better chance of weeding out 
those idio are simply not at a level to profit from the intensive course. 
Furthermore, candidates from outside academia vdio have gained flu- 
ency via some route other than formal study could arrange to be tested 
and could submit results of profidency interviews. This would provide 
selection committees with more reliable measures of candidates’ profi- 
ciency. 
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2. Results of profidenqr interviews could be useful as a tool for 
evaluating the efBcaqr of individual intendve summer programs rela- 
tive to one another* Analysis of results could facilitate identification of 
strong and weak points in each institute and could lead to concrete im- 
provements in future institutes* 

In order for these recommendations to be incorporated into our sum- 
mer programs, efforts in developiug interview techniques and in training 
interviewers need to be continued. In particular, more work needs to be 
done in developing the team model of interviewing in v^ch a trained lin- 
guist-interviewer works togeUier with a native speaker in conducting the 
interview. This would entail the training of native speaker instructors m* 
country. 



THE 1988 MADISON WORKSHOP ON 
ACTFL CERTIFICATION 



Linda Hunter 

University of Wisconsin 

The University of Wiscon^-Madison hosted a workshop on “Oral 
Proficiency Interviews” on May 18-21, 1988. The ACTFL workshop was an 
intensive, four day tester training workshop to prepare participants to ad- 
minister and rate oral proficiency interviews. The workshop was followed 
by a three to four month training period. In the post-workshop phase, par- 
ticipants conducted 25 cassette-recorded internews in two cycles at their 
home institutions and sent the interviews to their workshop tr^er. The 
trmner evaluated the interviews and recommended the participant for cer- 
tification as an oral proficiency tester. 

The trainers at the May workshop were Sally Magnan (French), 
Martha Marks (ESL), and Virginia Maurer (ESL). 

The participants included: 





Title VI 


Teaching 


Training 


Name 


Institution 


Language 


Language 


Dustin Cowell 


Wisconsin 


Arabic 


ESL 


Antonia Folarin 


Yale 


Yoruba 


ESL 


Carolyn Harford 


Michigan State 


Swahili 


ESL 


Magdalena Hauner 


Wisconsin 


Swahili 


ESL 


Linda Hunter 


Wisconsin 


Hausa 


ESL 


HugoKamya 


Boston 


Swahili 


ESL 


Patricia Kuntz 


Wisconsin 


Swahili 


ESL 


Richard Lepme 


Northwestern 


Swahili 


ESL 


Eyamba Bokamba 


Illinois 


Lingala/Swahili 


French 


Hazel Carter 


Wisconsin 


Shona/Kikongo 


French 



The participants at the May workshop recorded mterviews m Arabic, 
ESL, and French. The ACTFL certifications in Arabic, ESL, and French 
are the first step towards certification in African language testing. The 
next steps were to be taken at the two meetings listed below; 

African Studies Association, October 28 -31, 1988 

At this meeting oral proficiency mtervdew tapes of African l a n guages 
were to be evaluated to determine the standards for rating criteria. 
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African linguistics Conference, April 19 • 23, 1989 

For this meeting, a session on rating African languages that are less fre- 
quently taught was scheduled. 
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THE 1989 WORKSHOP ON TEAM TESTING 



Russell Schuh 
University of California at Los Angeles 



INTRODUCTION 

Over the past few years, the African language teaching community in 
the United States has been active in the oral profidenqr teaching and test- 
ing movement. There have been a number of meetings and workshops 
around the country stud^ng needs for African l a n guage teaching and 
modem techniques of language instruction and prodding tr aining in oral 
proficient testing, especially using the oral proficiency interview and the 
guidelines developed by ACTFL for the evduation of mterdewees’ per- 
formances. As a result of these workshops, a number of African l a ng ua g e 
teachers have become ACTFL certified testers in European languages. 

Certain problems particular to African languages became evident early 
in this period. First, there are no agreed standards for proficient testing 
in African lan g ua g es, much less certified testers to apply those standards. 
Developing certification procedures and, eventually, certifying testers will 
therefore have to be a “bootstrap” operation. Second, there are relatively 
few African languages teachers and relatively many languages being taught. 
Thus, it is unrealistic to expect certification of testers for any but the most 
commonly taught languages in the near future. 

THE FOCUS OF THE 
UCIA WORKSHOP 

It was this second problem that the UCLA workshop was meant to ad- 
dress. Is it possible to develop a reliable model for assessi ng the oral profi- 
ciency of students m languages for vdiich there are no certified testers? 
The model which we proposed to explore is one using a testing team (see 
the Dwyer contribution in this volume). One member of the team, the 
tester, would be a superior level speaker -of the target l a n guage ndio may or 
may not have some proficiency testing mqierience but udio is not a certified 
proficiency tester. The other member of the team, the advisor, would be a 
certified proficiency tester who may have no experience with the target lan- 
guage. The tester would conduct ^ actual interview entirely m the target 
lan guag e; the adwsor would orient the tester to the format of the interview, 
consult with the tester at a mid-point in the interview m order to pinpoint 
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areas wbere the sample needed to be amplified, and arrive at a final rating 
through consultation with the tester. 

The organizer of the UCLA workshop, Russell G. Schuh, invited each 
of the ten federally funded African studies centers to send representatives. 
At least one representative fi’om each of these universities attended. In ad- 
dition, Cornell University, which is in the process of expanding its African 
studies program and its African language offerings, sent two representa- 
tives. Though there are other Afirican language programs around the 
country for which this workshop could have been of possible interest, it 
seemed desirable to limit the number present for two reasons. Hrst, rince 
this was a workshop rather than a conference or symposium, a small group 
would permit more active participation by all those in attendance. Second, 
this workshop was really meant as an experiment using an untried model 
rather than a training sesrion for a proven model Therefore, preference 
was ^ven to persons who had alrea^ had some training, or at least eiqK)- 
sure, to the oral proficiency interriew, which was to serve as the baris for 
the experimental model. 

The federally funded centers had budgeted funds to allow members of 
their centers to attend. UCLA used this budget item to pay the ACTFL 
stipend and to defray the costs of the workshop. The universities with 
members in attendance contributed $200 each toward the cost of the work- 
shop in addition to paying the travel ejqwnses of their representatives. 
There were twenty-two persons in attendance in addition to the workshop 
leader, David Hiple. 

The UCLA workshop extended over two days. The first day was spent 
reviewing the oral proficient interview (OPI) model, the ACTFL rating 
scale, and posrible approaches to applyii^ thh model to the team testing 
format. During the morning of the fh^ day, David Hiple eqtlained the 
structure of the OPI, including warm-up, lewl checks, probes, and wind- 
down. He also presented the concept of role play as a technique for level 
checking and prolung. These conce^ were made concrete by viewing and 
discussing ridbotapes of interviews at various levels in Fmglish, Russian, 
and Hebrew. This review profited from discussion by members of the 
workshop vfvho have become certified testers in Fziglish or French. 

THE TEAM TESTING MODEL 

The remainder the first day and over an hour of the sectmd morning 
was spent disniising the team testing model The model as envisioned by 
David Hiple had the following structure: 

1. Discussion between members of the testing team on conduct of the 
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interview. 

2. Explanation to the intermewee (by the advisor) of the structure of 
the interview. 

3. Initial part of the interview, including warm-up, level checks, and 
probes. 

4. A mid-intermew conference between the admsor and the tester dur- 
ing which time the interviewee would go to another room and study 
a “Material Rewew Rle.”‘ 

5. Final part of the intermew, which would include (1) a role 
play selected by the team during the mid-interview conference with 
the intent of providing level checks and/or probes lacking during 
the initial part and (2) discussion utiliang something from the “Ma- 
terial Remew File.” The interview would end with the wind-down. 

6. Ratirg of the interviewee by the team. 

There was considerable discussion about the nature and advisability of 
the mid-interview conference. There were suggestions for alternative for- 
mats, such as assessment of the interviewee’s “floor” at a time prior to the 
interview so that the actual interview could be done without interruption 
and be aimed solely at level checks and probes. In the end, the workshop 
proceeded with the envisioned format. 

The second day of the workshop was devoted almost entirely to prac- 
tice interviews. Damd Hiple served as admsor for all the interviews and 
workshop participants who were native speakers of the target l a ng uages 
were the testers. There were four practice interviews, two in Swahili, one 
in Yoruba, and one in Hausa. In all but one interview, the testers had had 
no previous experience in conducting OPI’s. We had assembled a “Mate- 
rial Review File” consisting of several picture postcards of Afirican scenes 
and some advertisements from African magazines and newspapers. The 
interviewees all used this same file during the mid-interview conference. 

Following the format above, the advisor briefly eiqplained to each inter- 
mewee the structure of the interview. The conference between advisor and 
tester was not necessary race all the testers had attended the workshop 
discussions. The Testers then began the interviews, normally with a few 
greetings and general questions such as the intermewee’s name, vdiat he/ 
she was stud^ng, and so forth. In each case this part of the interview lasted 
anywhere from 15 minutes to 1/2 hour. The interviewee was then given 
the “Materials Reww Packet” and sent to another room while the first 
part of the interview was discussed. Instead of a conference between adm- 
sor and tester, the group as a Miole discussed the first part of the interview. 
Since several of those present understood each of the target languages, 
they were able to assess the nature of the sample elicited and to offer ad- 
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vice on the type of data required for a definitive rating. The advisor se- 
lected a role play card appropriate for eliciting the type of data needed^ and 
the interviewee was call^ back in to comidete thie interview. This con- 
sisted of a role play, discussion of something from the “Material Review 
File,” and a wind-down. 

The interviewees for the workshop all fell somevdiere nothin the inter- 
mediate range, so we were not able to test this model at the higher levels. 
However, there was a consensus that the model did provide a means for 
eliciting and evaluating a sample v^ch would permit an accurate rating on 
the ACTFL scale. Still, certain problems arose. The interviews were much 
longer than is dearable, most running dose to an hour. This was caused 
partly by the extra time taken up by the full group discussion during the 
mid-interview conference and partly because of the inei^rience of the 
testers, who tended to carry particular topics m the internew further than 
necessary. This latter problem is one that will have to be addressed as the 
model is applied. One problem that was antidpated in the first day's dis- 
cussion but vdiich did not materialize was concern over vdiether the mid- 
interview conference would tend to fragment the interview and cause a loss 
of momentum. In fact, we arrived at a consensus that this break in the in- 
terview was beneficial for the interdewee. This break seemed to provide a 
period of relaxation and reflection, such that when the interviewee re- 
turned, he/she was able to perform at least as well, and perhaps better 
than during the first phase. The latter part of the interview in virtually ev- 
ery case provided the data necessary for deriding between levels, say inter- 
mediate-low vs. intermediate-mid. 

During the closing discusuon following the interviews, the members of 
the workshop eiq>ressed the belief that the model as examinf4 seemed to 
be a viable tool for proficiency testing in languages wdiere there is little 
hope of having certified testers anytime soon. The workshqp was also use- 
ful in once again bringng together a group of Africanists wdio have been 
mvolved in proficiency teaching and testing so that we could discuss our 
experiences during the past year or so and impart some of these ideas to a 
broader group. 

NOTES 

’The “Material Review File,” which would serve as the baait for aone of the aeoond part 
of the interview, would consist of pictures, BM|azine or newsp ape r articles, advertisements, 
and so forth, which could stimulate liisnimion at anyof various levels on culturally appropri- 
ate topics. 
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REPORT ON THE BOSTON UNIVERSITY 
PROFICIENCY WORKSHOP 



John Hutchison 
Boston University 



The F unctio nal Guidelines Workshop took place from March 30 
through April 1, 1990, and was organized by John Hutchison of Boston 
Univendty. Most of the workshop was run by a consultant with wiiom the 
group had been working for some time, David Hiple, of the American 
Council of Teachers of Foreign Languages (ACTFL). Prior to the confer- 
ence, oral proficiency interviews in Hausa and Swahili were circulated for 
review. Following is a list of attendants: 



Frank O. Arasanyin 
Ann Biersteker 
Eyamba Bokamba 
Vicki Carstens 
Gitahi Gititi 
Carolyn Harford 
Magdelena Hauner 
Tom Hinnebusch 
David Hiple 

John Hutchison 
HugoKamya 
Will Leben 
Alamin Mazrui 
Sam Mchombi 
Lupenga Mphande 
Karl Reynolds 
Sandra Sanneh 



Yale Univeraty 

Yale Univeraty 

Univeraty of lUinois-Urbana 

Cornell University 

Yale University 

Michigan State University 

Univeraty of Wisconsin-Madison 

University of Califorcia-Los Angeles 

American Council of Teachers of Foreign 

Languages (ACTFL) 

Boston University 
Boston University 
Stanford University 
Ohio State University 
University of Califomia-Berkeley 
Ohio State University 
Boston University 
Yale University 



Given that the majority of the participants were involved vrith the 
teaching of Swahili, it was agreed that the workshop would concentrate on 
making progess toward devek^ung oral proficienqr guidelines for Swahili, 
and that the other language groups represented could meet separately to 
discuss problems associated with oral proficiency testing in their languages. 

The two-day proficient workshop was conducted by ACTFL oral pro- 
ficiency trainer Da^d Hiple. More than a day and a hitlf were devoted to 
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analyzing videotaped mal profidenqr interviews conducted by trained 
interviewers and to practicing interviews by the participants, many of whom 
had had previous ACTFLprr^denty training. Each practice interview was 
critiqued and together the group assigned an oral proficiency level for the 
interviewee. The need for language-specific giudelines for Ae oral profi- 
ciency interview was discussed, and the need to establish proficiency guide- 
lines for Swahili was reiterated throughout the workshop. 

The afternoon of the second day ended with a discussion of the pros 
and cons of establishing guidelines along the ACTPL model The group 
agreed that it was important to wenrk toward that goal but that it would 
take time. It was concluded that the mterviews made during the workshop 
would be copied and circulated to all of the Swahili-teaching programs in 
the country, and that an effort would be made to organize a proficiency 
guidelines development workshop for next year. All were encouraged to 
beg^ trying to capture and characterize the elements of the interviews at 
the various levels. 

On the third day, the following presentations were gjven: 

Hugo Kamya: “Demonstration of Oral Proficiency Testing Usung a 
Language Consultant” 

Eyamba Bokamba: “Funding Opportunities for the Less-Commonly 
Taught Languages through the Ford Foundation” 

Ann Biersteker and Will Leben: “Using Videotaped Folktales in 
the African Language Classroom” 

All participants agreed that they would continue to pursue ACTFL cer- 
tification among their members and that they would support the Indiana 
ACTFL worktop in May 1990. They eiqiressed a desire to have one or 
more of thdr members eventually be certified as tester truners, so that the 
African languages group would then be able to train their own testers and 
no longer be dependent on ACTFL, which some of the group found to be 
extremely etqienstve. There was a consensus that the group should 
vrork to formalize their team teaching technique together with a language 
consultant (as demonstrated by Hugo Kamya in his presentatioo). The 
Hausa-teaefaing participants agreed that they would also begin working cm 
guidelines for the Hausa language based on interviews t^ch they had al- 
ready archived. 
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APPENDIX A 

Projects of the Title VI African Studies Centers 
Concerning African Languages and Proficiency Evaluation 

1979 Workshop: Needs and Priorities for the Teaching of African 
Languages in the United States in the 1980s. Michigan State Uni- 
versity (Dwyer and Wiley, 1981). This workshop led to a list that 
identified 82 major national and international African l a ng uages 
that need to be taught ^en requested in the United States. 

1984 Workshop: Guidelines for the Development of Writing and 
Evaluating African Language Materials. Michigan State Univer- 
sity. Dwyer. (Dwyer, 1986a) 

1985 Project: aimed at the identification of resources on a world- 
wide basis available for the study of African languages mcluding a 
preliminary evaluation of such materials. Michigan State Univer- 
sity David Dwyer. (Dwyer, 1986) 

1985 Workshop: focusing on the initial exploration of the suitability 
of the ACT^ oral proficiency testing model for African lan- 
guages. Stanford Univerrity. William Lcben. 

1985 Project: The Development of Working ACTFL Guidelines for 
Swahili, Hausa, and Arabic. Indiana University. Roxana Ma New- 
man. 

1986 Team Approach to Proficiency Evaluation. 

1987 A joint project by Bennett and Biersteker to develop profi- 
ciency profiles for Hausa, Swahili, and Arabic (Bennett and 
Biersteker). 

1987 The New Wisconsin Workshop 

1985 The University of Illinois Project for CAI in Swahili and 
Wolof. 
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APPENDIX B 

ACTFLLeveb* 



SUPERIOR: 


Can support opinions, hypothesize, talk 
about al^act topics. Gets into, through, 
and out of an unfamiliar situation. 


ADVANCED PLUS: 


Can perform at the superior level some- 
times, but not consistently. 


ADVANCED: 


Can narrate and describe in past, present, 
and future time, and get into, through, 
and out of a survival situation with a com- 
plication. 


INTERMEDIATE HIGH: 


Can perform at thr advanced level some- 
times, but not consistently. 


INTERMEDIATE MID: 


Can aeate with language, ask and answer 
questions on familiar topics. 


INTERMEDIATE LOW: 


Gets into, through, and out of a simple 
survival situation. 


NOVICE HIGH: 


Can perform at the intermediate level 
sometimes, but not consistently. 


NOVICE MID: 
NOVICE LOW: 


No functional ability. 

Limited to memorized material. 


0 


No ability in the language v^tsoever. 



*Source: Part of an ACTFL packet handed out at the workshop. This ex- 
ample is intended to be only a brief characterization of the ACTFL profi- 
ciency levels. 
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APPENDIX C 

Language Priorities Categories 
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Group A Languages (Highest Priority) 

1. Alcan 13. Ruanda/Rundi 

2. Amharic 14. Sango 

3. Arabic 15. Shona 

4. Chewa/Nyanja 16. Somali 

5. Fulfulde (Fula/Peulh/Fulani) 17. Sotho/Tswana (Ndebele) 

6. Hausa 18. Swahili 

7. Igbo 19. Tigrinya 

8. Kongo 20. Umbundu 

9. Malagasy 21. Wolof 

10. Mandingo 22. Xhosa/Zulu/Swazi 

11. Ngala (Ungala) 23. Yoruba 

12. Oromo (Galla) 



Group B Languages (Second Priority) 



1. An3i/Baule 

2. Bameleke 

3. Bemba 

4. Berber 

5. Chokwe/Ruund 

6. EGk/Ibibio 

7. Ganda (Luganda) 

8. Gbaya 

9. Gbc (Ewc/Mina/Fon) 

10. Kalenjin (Nandi/Kipsigis) 

11. Kamba (Kikamba) 

12. Kanuri 

13. Kikuyu 

14. Kimbundu 

15. Krio/Pidgin (Cluster) 



16. Luba 

17. Luo/Acholi/Lango 

18. Luyia 

19. Makua/Lomwe 

20. Mende/Bandi/Loko 

21. Mongo/Nkundo 

22. Moore/Mossi 

23. Nubian 

24. Senufo 

25. Songhai 

26. Sukuma/Nyamwezi 

27. Tiv 

28. Tsonga 

29. Yao/Makonde (Bulu) 

30. Zande 
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Ornun C Languages (Third Pnority) 


1. Dinka (Agar/Bor/Padaag) 


16. Nuer 


2. Edo(Bini) 


17. Nupe 


3. Gogo (Chigogo) 


18. Nyakusa 


4. Gurage 


19. Nyoro 


5. Hehe 


20. Sara 


6. Idoma 


21. Serer 


7. Igbira (Ebira) 


22. Sidamo 


8. Ijo 


23. Soninke 


9. Isle de France Creole 


24. Suppire 


10. KpeUe 


25. Susu 


11. idv/Bassa 


26. Temne 


12. Lozi (Silozi) 


27. Teso/Turkana 


13. Maasai 


28. Tumbuka 


14. Mem 


29. Venda 


15. Nama (Damara) 
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APPENDIX D 

Advantages of Oral Proficiency Assessments 

Profidency-based language requirements 

Many insritu tinns have begun looking towards a competency based lan- 
guage requirement vduch could eadly be based on the attainment of a 
given ACTTL level. 

Title VI level two fellowships 

In the event that a second level of National Resource Fellowship 
becomes established, the applicant would have to demonstrate a desig- 
nated threshold level of profidency in order to qualify for the fellow- 
ship. 

Summer institute abroad fellowships 

ACTFL ratings could provide a fair and dependable means for identify- 
ing those students who would benefit most from a summer institute 
abroad. 

Uniform expectations 

As long as ACTFL evaluations remain valid and reliable, they can pro- 
vide the hasis of establishing uniform eiqpectations of learner perform- 
ance in the African language programs in this country. 

Field research grants 

ACTFL ratings vdll make it easier for applicants to demonstrate that 
t hrV lan guage profidency is adequate to conduct the field research that 
they have proposed. 

Career opportunities 

Language teachers (Swahili, Hausa, and Arabic) will be able to demon- 
strate their level of lan gwagf. profidency vAen being considered for a 
lan giiagft t eaching situation. Other professions, such as those in devel- 
opment, the Peace Corps and the Foreign Service, may also benefit 
from the availability of these profidency ratings. 

Evaluating language programs 

Having established uniform expectations for learner achievement on a 
lan giiagi* by i«t> guagft basis, individual programs can e x a min e the rela- 
tive effectiveness of their methodolopes, program structure and mate- 
rials. 
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Serving as the basis for proficiency profiling 

Some work has been initiated (Bennett, Biersteker, and DihoS) to- 
wards the development of diagnostic {Krt^dency profiles vdiich can be 
used to give both teachers and students alike a clearer understanding of 
their strengths and weaknesses and in so doing identify the areas vdiich 
need to be developed to move on to a higher level of proficiency. 
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APPENDIX E 



Preliminaiy Listing of Putkipants l^^ng to Review 
Pr<^icieM7 Interviews for Specific Languages 



Universitv 


Name 


IjHguages 


Berkeley 


Tucker Childs 
Others 


Kisi 

Yoruba, Igbo, Swahili 


Boston 


Katherine Demuth 
John Hutchison 
Jennifer Yanco 


Sesotho/Setswana, Swahili 
Hausa, Bambara, Kanuri 
Lingala, 21arma/Songhai 


George Mason 


Beverly Mack 


Hausa 


Illinois 


Eyamba G. Bokamba 
Mallafe Drame 


Lingala, Swahili 
Wolof, Mandinka 


Northwestern 


Muhammad S. Eissa 
Richard Lepine 


Arabic 

Swahili 


Ohio State 


Mahdi Alush 


Arabic 


UCLA 


Russell G. Schuh 


Hausa 


Wisconsin 


Hazel Carter 
Patrida Kuntz 
Mark Plane 


Shona, Tonga, Kongo 

Yoruba 

Swahili 


Yale 


Ann Biersteker 
Vicki Carstens 
Others 


Swahili, Kikuyu 
Yoruba, SwahiU 
2Udu, Shona, Setswana, and 
Amharic 


Stanford 


WillLeben 


Hausa 


Michigan State 


David Dwyer 
Others 


Krio, West African Pidgin 
F-nglUh, Mende 
Amharic, Swahili, Hausa 
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